|
The binomial sum variance inequality states that the variance of the sum of binomially distributed random variables will always be less than or equal to the variance of a binomial variable with the same ''n'' and ''p'' parameters. In probability theory and statistics, the sum of independent binomial random variables is itself a binomial random variable if all the component variables share the same success probability. If success probabilities differ, the probability distribution of the sum is not binomial.〔Butler K, Stephens M. 1993. The distribution of a sum of binomial random variables. ( Technical Report No. 467. ) Department of Statistics, Stanford University〕 The lack of uniformity in success probabilities across independent trials leads to a smaller variance.〔Nedelman, J and Wallenius, T., 1986. Bernoulli trials, Poisson trials, surprising variances, and Jensen’s Inequality. The American Statistician, 40(4):286–289.〕〔Feller, W. 1968. An introduction to probability theory and its applications (Vol. 1, 3rd ed.). New York: John Wiley.〕〔Johnson, N. L. and Kotz, S. 1969. Discrete distributions. New York: John Wiley〕〔Kendall, M. and Stuart, A. 1977. The advanced theory of statistics. New York: Macmillan.〕〔Drezner, Z. and Farnum, N. 2007. A generalized binomial distribution. Communications in Statistics – Theory and Methods, 22(11):3051–3063.〕 and is a special case of a more general theorem involving the expected value of convex functions.〔Hoeffding, W. 1956. On the distribution of the number of successes in indepdendent trials. Annals of Mathematical Statistics (27):713–721.〕 In some statistical applications, the standard binomial variance estimator can be used even if the component probabilities differ, though with a variance estimate that has an upward bias. ==Inequality statement== Consider the sum, ''Z'', of two independent binomial random variables, ''X'' ~ B(''m''0, ''p''0) and ''Y'' ~ B(''m''1, ''p''1), where ''Z'' = ''X'' + ''Y''. Then, the variance of ''Z'' is less than or equal to its variance under the assumption that ''p''0 = ''p''1, that is, if ''Z'' had a binomial distribution.〔Millstein J, Volfson D. 2013. ( Computationally efficient permutation-based confidence interval estimation for tail-area FDR. ) Frontiers in Genetics | Statistical Genetics and Methodology 4(179):1–11. PMCID: PMC3775454〕 Symbolically, Var(''Z'') ≤ E() (1 – E() / (''m''0 + ''m''1) ). Proof. If ''Z'' has a binomial distribution with parameters ''n'' and ''p'', then the expected value of ''Z'', E() = ''np'' and the variance of ''Z'' is equal to ''np''(1 – ''p'') or equivalently, Var(''Z'') = E() (1 – E() / ''n''), where in this case, ''n'' = ''m''0 + ''m''1. The random variables ''X'' and ''Y'' are independent, therefore the variance of the sum is equal to the sum of the variances, that is, Var(''Z'') = E() (1 – E() / ''m''0) + E() (1 – E() / ''m''1). Thus, if we can show that, E() (1 – E() / ''m''0) + E() (1 – E() / ''m''1) ≤ E() (1 – E() / (''m''1+''m''0)), then we have proved the theorem. Simplifying this inequality yields, E()(1 – E()/''m''0) + E()(1 – E()/''m''1) ≤ (E() + E())(1 – (E() + E())/(''m''0 + ''m''1)), which leads to the relation (''m''1E())2 – 2''m''0''m''1E()E() + (''m''0 E())2 ≥ 0, or equivalently, (''m''1E() – ''m''0E())2 ≥ 0, which is true for all independent binomial distributions that ''X'' and ''Y'' could take, because a square of a real number is always greater than or equal to zero. Although this proof was developed for the sum of two variables, it is easily generalized to greater than two. Additionally, if the individual success probabilities are known, then the variance is known to take the form〔 : where . This expression also implies that the variance is always less than that of the binomial distribution with , because the standard expression for the variance is decreased by ''ns''2, a positive number. 抄文引用元・出典: フリー百科事典『 ウィキペディア（Wikipedia）』 ■ウィキペディアで「Binomial sum variance inequality」の詳細全文を読む スポンサード リンク
|